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A SYSTEM AND METHOD FOR DYNAMIC 
DOCUMENT LAYOUT 

FIELD 

5 [0001] The present invention relates to systems and methods for case 

based, dynamic document layout and, more particularly, to a system and method 
for case based, dynamic document layout using case based mutations. 

BACKGROUND 

[0002] With today's document workflows, the creator of a document 

10 often does not have control over the final appearance of the document. For 
example, documents can be posted on and retrieved fi*om the web or can be 
emailed to their audience. The individual which has obtained or received the 
document selects the printer or display device on which the document is going to 
be displayed. Unfortunately, the document may not be properly formatted for 
1 5 printing or display on the selected printer or display device. 

[0003] To resolve this problem, automated document-layout systems have 

been developed. These prior document-layout systems have relied on the use of 
fixed algorithms and style sheets to determine a document's layout. Although 
these types of document-layout systems work for some applications, the result is 

20 rigid, inflexible and thus limits their use to certain classes of document and types 
of layout. Additionally, these types of systems tend to make all documents look 
alike which is not always desirable. To that end, a genetic algorithm approach to 
layout has been developed, enabling varying layouts to be automatically 
generated. For such a genetic algorithm process, a series of mutations is applied 

25 to a layout in order to evolve it to an optimal layout. However, two challenges 
remain in current systems that apply such mutations. First, the mutation 
algorithms must be programmed beforehand, and then only those that have been 
programmed can be applied. This is a difficulty since it is not always possible to 
anticipate beforehand and create algorithms for all of the possible coordinated 

30 mutations that might be valuable in an automated document-layout scenario. A 
second remaining challenge in applying mutations for automated layout is 
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knowing which mutations to apply, and in what sequence to apply them. The 
process detailed in the present invention addresses both of these challenges. 

SUMMARY 

[0004] A system for case based, dynamic document layout in accordance 

5 with embodiments of the present invention includes a comparison system, a 
determination system, and a mutation system. The comparison system that 
compares one or more elements of at least a portion of an original document 
against the same elements in at least a portion each of a plurality of stored 
documents. The determination system identifies the stored document with the 
10 portion which is closest to the portion of the original document based on the 

comparing. The mutation system applies one or more mutators to the portion of 
the original document that was used in the portion of the identified stored 
document. 

[0005] A method and a computer readable medium having stored thereon 

15 instructions for case based, d5aiamic document layout which when executed by a 
processor, causes the processor to perform steps comprising comparing one or 
more elements of at least a portion of an original document against the same 
elements in at least a portion each of a plurality of stored documents. The stored 
document with the portion which is closest to the portion of the original document 
20 is identified based on the comparing. The one or more mutators are applied to the 
portion of the original docxmient that was used in the portion of the identified 
stored document. 

[0006] The present invention provides a system and method for a dynamic 

document layout that is able to leam new intelligent mutations during operations. 
25 The present invention also determines the most appropriate sequence of mutators 
given the current individual's characteristics. By combining CEise-based mutations 
with genetic algorithms for dynamic document layout, the present invention 
provides a more efficient and reliable automated scheme for dynamic document 
layout. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] FIG. 1 is a block diagram of a system for a dynamic document 

layout in accordance with embodiments of the present invention; 

[0008] FIG. 2 is a flow chart of a method for a dynamic document layout 

5 in accordance with embodiments of the present invention; 

[0009] FIG. 3 is a screen shot of a displayed document with increased 

font size to increase legibility; 

[00010] FIG. 4 is a screen shot of a displayed document with shorter line 

lengths to increase legibility; 

10 [00011] FIG. 5 is a screen shot of a document in need of a mutations; 

[00012] FIG, 6 is a screen shot of the document shown in FIG. 5 with an 

inappropriate choice and sequence of mutators; and 

[00013] FIG. 7 is a screen shot of the document shown in FIG. 5 with an 

optimized choice and sequence of mutators. 

1 5 DETAILED DESCRIPTION 

[00014] A system 10 for dynamic document layout in accordance with 

embodiments of the present invention is illustrated in FIG. 1 . The system 10 
includes a document layout processing system 12 and printers 14 and 16, although 
the system 10 can comprise other nxambers and types of systems, devices, and 
20 components in other configurations. The present invention provides a system 10 
and method for dynamic document layout that is able to learn new intelligent 
mutators during operations and is able to determine the most appropriate sequence 
of mutators given a document's current characteristics. 

[00015] Referring to FIG. 1, the document layout processing system 12 is 

25 coupled to the printers 14 and 16, although the document layout processing 
system 12 could be coupled to other types and numbers of devices in other 
configurations. A variety of communication systems and/or methods can be used 
to operatively couple and communicate between the document layout processing 
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system 12 and the printers 14 and 16, including a direct connection, a local area 
network, a wide area network, the world wide web, modems and phone lines, or 
wireless commimication technology each having communications protocols, hi 
these embodiments, the printers 14 and 16 are coupled to the document layout 
5 processing system 12 by a hard- wire connection over a loceil area network, 
although other types of cormections, devices, and networks, such as a wireless 
conmiunication system, could be used 

[00016] The document layout processing system 12 includes a processor 

18, a memory storage device 20, a user input device 22, a display device 24, an 

10 and an input/output interface device 26 which are coupled together by a bus 28 or 
other link, although other types of document layout processing systems 
comprising other numbers and types of components in other configurations can be 
used. The processor 18 executes a program of stored instructions for one or more 
aspects of the present invention as described herein, including the method for case 

15 based, dynamic document layout as described with reference to FIG. 2. 

[00017] The memory storage device 20 stores the progranmied instructions 

for one or more aspects of the present invention as described herein, including the 
method for case based, dynamic document layout as described with reference to 
FIG. 2, for execution by the processor 18, although some or all of the programmed 

20 instructions could be stored and/or executed elsewhere, such as in printer 14 or 
printer 1 6. A variety of different types of memory storage devices, such as a 
random access memory (RAM) or a read only memory (ROM) in the system or a 
floppy disk, hard disk, CD ROM, or other computer readable medium which is 
read from and/or written to by a magnetic, optical, or other reading and/or writing 

25 system that is coupled to the processor, could be used for memory storage device 
20 to store the programmed instructions described herein, as well as other 
information. The user input device 22 enables an operator to generate and 
transmit signals or commands to the processor 18, such as a request to print or 
display a docxmient on printer 14 or printer 16. A variety of different types of user 

30 input devices could be used for user input device 22, such as a keyboard or 

computer mouse. The display device 24 displays information for the operator of 
the document layout processing system 12, such as an image of the document 
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layout or the status of the print job at printer 14. A variety of different types of 
display devices could be used for display device 24, such as a display monitor. 
The input/output interface system 26 is used to operatively couple and 
communicate between the document layout processing system 12 and the printers 
5 14 and 16. 

[00018] The printer 14 is coupled to the document layout processing 

system 12, although other types of devices can be coupled to the document layout 
processing system 12. The printer 14 prints documents received from the 
document processing system 12. The printer 14 has a particular set of 
1 0 characteristics when printing a document which effect the resulting printed image 
of the document, such as margins or a particular paper size on which the 
document is printed. Since the components of a printer 14, including its 
connections and operation, are well known, they will not be described in detail 
here. 

15 [00019] The printer 16 is also coupled to the document layout processing 

system 12, although other types of devices can be coupled to the document 
processing system 12, The printer 16 also prints documents received from the 
document processing system 12. The printer 16 also has a particular set of 
characteristics when printing a document which effect the resulting printed image 

20 of the document which are different from the characteristics of printer 14, 
although both printers 14 and 16 could have the same characteristics when 
printing a document. Like printer 14, the components of a printer 16, including 
their connections and operation, are well known, they will not be described in 
detail here, 

25 [00020] A method for a case based, dynamic document layout in 

accordance with embodiments of the present invention will now be described with 
reference to FIGS. 1-7. In step 100, the document processing system 12 selects a 
portion of an original document, although other portions or all of the original 
document could be selected for determining a layout. The portion of the 

30 document selected is the portion that needs re-layout or adjustment. The original 
document can be obtained in a variety of different manners, such as retrieved from 
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the web, from an e-mail attachment, from another computer system, or from a 
docimient created by the operator. 

[00021] In step 102, the docxraient processing system 12 compares one or 

more elements of the selected portion of the original document against the same 
5 types of elements in portions of a plurality of other stored documents obtained 
from memory storage device 20, although other types of comparisons of other 
numbers and types of elements and other portions could be used. A variety of 
different types of elements could be used by the document processing system 12 
in this comparison, such as font size, font type, number of lines of text, line 
10 spacing, number of alphanumeric characters, size of an outer perimeter of the 
arrangement of alphanumeric characters, and number of images. The document 
processing system 12 can assign a score to each comparison, such as one score for 
a complete match, another score for a partial match, and no score when there is no 
match, although other manners for assigning a score can be used. 

15 [00022] In step 104, the document processing system 12 identifies which 

stored document with the portion which is closest to the portion of the original 
document based on the comparison of the selected elements. In these 
embodiments, the document processing system 12 generates a score based on the 
comparison of the elements of the selected portion of the original docviment 

20 against the same types of elements in portions of a plurality of other stored 

documents. The document processing system 12 identifies the stored document 
with the portion which is closest to the selected portion of the original document 
based on the highest generated score, although the document processing system 12 
could use other ways to identify the stored document with the closest portion. 

25 [00023] In step 106, the document processing system 12 obtains the one or 

more mutators used in the identified, stored document from memory storage 
device 20 for possible use in the selected portion of the original document. A 
variety of different types of mutators could be obtained, such as mutators for 
adjusting a font of type, adjusting line spacing, adjusting at least one color, and 

30 adjusting a location of at least one section in the portion of the original document. 
For example, the mutator for increasing font size to increase legibility is 
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illustrated in FIG. 3 and the mutator for making the line lengths shorter to increase 
legibility is shown in FIG. 4, although again other types of mutators alone or in 
different combinations could be obtEiined and used. 

[00024] Referring back to FIG. 2, in step 108 the document processing 

5 system 12 identifies the device, such as printer 14 or printer 16, on which the 
original document is to be displayed. The document processing system 12 
identifies the device based on instructions received from an operator using user 
input device 22 requesting a particular device to display the original document, 
although other ways of identifying the display device can be xised, such as a 

10 programmed selection in the memory storage device 20 of document processing 
system 12 to use a particular printer 14 or 16 for a print job. As part of the 
identification process, the document processing system 12 obtains information 
from memory storage device 20 about the characteristics of the device, although 
other ways of obtaining information about the characteristics of the device can be 

1 5 used, such as an inquiry by the document processing system 12 to the device, such 
as printer 14 or 16, for the information. 

[00025] In step 110, the document processing system 12 determines which 

of the one or more mutators obtained from the identified, stored document to use 
on the selected portion of the original document. The document processing 

20 system 12 determines which of the mutators to use based on the characteristics of 
the device on which the original document is going to be displayed and based on 
one or more elements of the original document, although other manners for 
determining which of the mutators to select can be used. For example, if the 
printer 14 selected for the printing job is a black-and-white printer, then a mutator 

25 for altering color obtained from the identified, stored document is irrelevant and 
would not used by the document processing system 12. In another example, the 
document processing system 12 could have lists of mutators stored in memory 20 
which are associated with particular types of documents, such as for text 
documents, documents with text and images, and documents with images, and 

30 then the document processing system 12 would detemiine to use the obtained 

mutators that were on appropriate stored list for the type of document that matches 
the portion of the original document or the original document. 
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[00026] The document processing system 12 also determines using one or 

more algorithms for document layout stored in memory storage device 20 and one 
or more other style sheets stored in memory storage device 20 one or more other 
mutators to apply to the selected portion of the original document, although other 
5 manners for determining which, if any, other the mutators to use can be 
implemented. Standard or generic algorithms and methods for determining 
mutators and other parameters for document layout, which are stored as 
programmed instructions for execution by document processing system 12, are 
disclosed in pending US Patent Application Serial No. 10/202046 for a, 

10 "Constraint-Optimization System and Method for Document Component Layout 
Generation" and pending US Patent Application Serial No. 10/202188 for a, 
"Constraint-Optimization System and Method for Document Component Layout 
Generation" which are both herein incorporated by reference in their entirety. 
Since these algorithms and methods used in determining mutators for standard or 

15 generic document layout are well known, they will not be described in detail here 
again. 

[00027] In step 112, the document processing system 12 determines an 

order or sequence for applying the one or more obtained mutators and the one or 
more determined mutators to the selected portion of the original document. In 

20 these particular embodiments, the document processing system 12 determines the 
order based on the order the obtained mutators were used in the identified, stored 
document, although other manners for determining the order for applying the 
mutators could be used. For example, the ordering may be a learned function 
based on noting the effectiveness of orderings on the document quality measure. 

25 In another example, the selected order for applying mutators could be based on a 
predetermined priority order for applying mutators which is stored in memory 20. 
The document processing system 12 would determine where each of the obtained 
mutators occurred in the stored priority order and then would base the order of 
applying the mutators based on this determination. 
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[00028] In step 1 14, the document processing system 12 applies the 

selected one or more obtained mutators and the one or more determined mutators 
in the determined ordered order to the selected portion of the original document. 
Since methods for applying mutators to a document are well known, they will not 
5 be described in detail here again. 

[00029] By way of example only, a document which needs a new 

document layout for display is illustrated in FIG. 5. If the present invention is not 
utilized, then the application of mutators to the document can result in an 
inappropriate choice and sequence of applying mutators to the document as 
10 illustrated in FIG. 6. If the present invention is utilized, then the choice and 

sequence of the applied mutators produces a desired result for the document to be 
displayed as illustrated in FIG. 7. 

[00030] In step 116, the document processing system 12 stores the selected 

portion of the original document with the applied mutators as one of the stored 
1 5 documents in memory storage device 20. The newly stored portion of the original 
document can now be used to assist with determining the layout of other portions 
of the original document or of other documents to be displayed. 

[00031] In step 118, the document processing system 12 determines if 

another portion of the original document should be selected for determining a 

20 dynamic docximent layout. If one or more additional portions in the original 

document are desired to be selected, for example if other portions of the original 
document have not already been selected, then the Yes branch is taken to step 
1 102 where the process for determining a dynamic document layout begins again 
for the newly selected portion of the original document in the same manner as 

25 described above. If no more portions in the original document are desired to be 
selected, for example if the entire original document was selected for processing 
or all of the portions of the original document have already been selected, then the 
No branch is taken to step 120 where the process for determining a dynamic 
document layout ends. 



- 10- 



[00032] Although one embodiment of the method for a case based, 

dynamic document layout for one embodiment of the present invention is 
described above, other embodiments of the present invention can have other 
combinations of the steps without some of these steps, such as one or more of the 
5 steps 108, 110, 1 12, 1 16, and 118 which are described in greater detail above. By 
way of example, another embodiment of the method for a case based, dynamic 
document layout comprises performing the steps 100, 102, 104, 106, 1 14, 1 16, 
118, and 120 described in greater detail above. 

[00033] Accordingly, the present invention provides a case-based approach 

10 to applying mutators to a document to obtain a desirable document layout. The 
present invention also continuously stores the determined layouts for use in 
determining the layout of future documents. By combining case-based mutators 
with genetic algorithms for dynamic document layout, the present invention 
provides a more efficient and reliable automated scheme for dynamic document 
15 layout. 

[00034] Having thus described the basic concept of the invention, it will be 

rather apparent to those skilled in the art that the foregoing detailed disclosure is 
intended to be presented by way of example only, and is not limiting. Various 
alterations, improvements, and modifications will occur and are intended to those 

20 skilled in the art, though not expressly stated herein. These alterations, 

improvements, and modifications are intended to be suggested hereby, and are 
within the spirit and scope of the invention. Additionally, the recited order of 
processing elements or sequences, or the use of numbers, letters, or other 
designations therefor, is not intended to limit the claimed processes to any order 

25 except as may be specified in the claims. Accordingly, the invention is limited 
only by the following claims and equivalents thereto. 



